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The motivation of getting rewards or avoiding punishments 
reinforces learning behaviors. Although the neural mechanisms 
underlying the effect of rewards on episodic memory have been de- 
monstrated, there is little evidence of the effect of punishments on 
this memory. Our functional magnetic resonance imaging (fMRI) 
study investigated the effects of monetary rewards and punish- 
ments on activation during the encoding of source memories. 
During encoding, participants memorized words (item) and 
locations of presented words (source) under 3 conditions (Reward, 
Punishment, and Control). During retrieval, participants retrieved 
item and source memories of the words and were rewarded or pe- 
nalized according to their performance. Source memories encoded 
with rewards or punishments were remembered better than those 
without such encoding. fMRI data demonstrated that the ventral 
tegmental area and substantia nigra and nucleus accumbens acti- 
vations reflected both the processes of reward and punishment, 
whereas insular activation increased as a linear function of punish- 
ment. Activation in the hippocampus and parahippocampal cortex 
predicted subsequent retrieval success of source memories. 
Additionally, correlations between these reward/punishment-related 
regions and the hippocampus were significant. The successful en- 
coding of source memories could be enhanced by punishments and 
rewards, and interactions between reward/punishment-related 
regions and memory-related regions could contribute to memory en- 
hancement by reward and/or punishment. 

Keywords: functional magnetic resonance imaging, punishment, reward, 
source memory 



Introduction 

The motivation of receiving rewards or avoiding punishments 
enhances learning performance in experimental animals 
(Rolls 2007). Although human functional neuroimaging 
studies have demonstrated the neural mechanisms related to 
the effect of the motivation of receiving rewards on episodic 
memory (Adcock et al. 2006; Shigemune et al. 2010), there is 
little evidence of the effect of the motivation of avoiding pun- 
ishment on this memory. This functional magnetic resonance 
imaging (fMRI) study investigated the effects of the motiv- 
ation of monetary rewards and punishments on neural acti- 
vation during the encoding of item and source memories. 

The reward-related enhancement of episodic memory 
could be explained by the modulatory effect of the dopamin- 
ergic pathway on memory-related brain regions. Previous 
neurophysiological studies suggest that the dopaminergic 



neurons could code the predictions and prediction errors of 
rewards, and that these processes could reinforce the ap- 
proaching behaviors to rewards (Schultz et al. 1997; Schultz 
1998). The reward-related information is processed in the 
dopaminergic pathway, where the dopaminergic neurons in 
the ventral tegmental area and substantia nigra (VTA/SN) are 
projected to the nucleus accumbens (NA) and medial orbito- 
frontal cortex (mOFC; Olds and Milner 1954; Haber and 
Knutson 2010). There is also anatomical evidence that the 
VTA/SN dopaminergic neuron maintains direct projections to 
the hippocampus as a memory-related region (Carter and 
Fibiger 1977; Amaral and Cowan 1980; Swanson 1982; 
Samson et al. 1990; Gasbarri et al. 1991; Gasbarri, Packard, 
et al. 1994; Gasbarri, Verney, et al. 1994; Lewis et al. 2001). 
Functional neuroimaging studies have shown that these 
reward-related regions are activated together with the 
memory-related hippocampal region, which is involved in the 
vivid remembering of memory details including source or 
contextual information of events (Wittmann et al. 2005; 
Adcock et al. 2006; Tsukiura and Cabeza 2008; Wittmann 
et al. 2008; Shigemune et al. 2010; Tsukiura and Cabeza 
2011). The interaction between the reward-related VTA/SN 
region and the hippocampus has been identified in animal 
studies, where dopaminergic neurons in the VTA/SN modu- 
late hippocampal activities, and the interaction contributes to 
the hippocampus-dependent learning and memory (Gasbarri 
et al. 1996; O'Carroll et al. 2006; Martig and Mizumori 2011; 
Nazari-Serenjeh et al. 2011). Interactions between reward- 
related regions, including VTA/SN, NA, or mOFC, and 
recollection-related hippocampal regions could be important 
in the enhancement of memory details by rewards. 

The motivation of avoiding punishments and receiving 
rewards reinforces learning behaviors (Seymour et al. 2007). 
As memory enhancement by monetary rewards is modulated 
by an interaction between reward-related and memory-related 
brain regions, punishment-related enhancement of episodic 
memory could be explained by interactions between regions 
associated with the processing of punishments and regions 
associated with the processing of memory. Previous neuroi- 
maging studies have demonstrated the involvement of VTA/ 
SN and NA in the prediction of both rewards and punish- 
ments (Knutson et al. 2000; Samanez-Larkin et al. 2007; 
Wrase et al. 2007; Carter et al. 2009). Thus, VTA/SN and NA 
could show significant activations during the prediction of 
both punishments and rewards. 

Another region that may be associated with the prediction 
of receiving punishments is the insula. There is cognitive 
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neuroscience evidence that insular activation is induced by 
the processing of pain or aversion, and that the activation pre- 
dicts subsequent avoidance behaviors (Knutson and Greer 
2008). Neuroscientific studies involving experimental animals 
have demonstrated that the insular cortex is anatomically and 
functionally connected with the hippocampus (Pribram 
and Maclean 1953; Friedman et al. 1986; Rutecki et al. 1989), 
and that the insular cortex collaborates with the hippocampus 
during memorizing aversive tastes (Yefet et al. 2006). Func- 
tional neuroimaging studies involving humans have reported 
that greater activations in the insular cortex have been found 
in the successful encoding of aversive events or faces with 
bad impressions (Rasch et al. 2009; Tsukiura et al. 2012). 
Taken together, these results may indicate that memory en- 
hanced by the motivation of avoiding punishments could be 
modulated by interactions between the VTA/SN, NA, or 
insular regions, which are associated with the prediction of 
punishments, and the hippocampus, which is associated with 
the processing of memory details. 

In view of the previous studies mentioned above, we 
hypothesized that the enhancing effects on episodic memory 
due to the motivation of receiving rewards and avoiding pun- 
ishments could reflect an influence of the VTA/SN, NA, 
mOFC, and insular regions, which are involved in the predic- 
tion of rewards and/or punishments, on the hippocampal and 
parahippocampal memory system and, in particular, on a 
region strongly associated with the successful encoding of 
memory for contextual details (recollection): The hippo- 
campus and parahippocampal cortex (PHC; Yonelinas 2002; 
Davachi 2006; Diana et al. 2007; Eichenbaum et al. 2007). In 
functional neuroimaging studies, where study-phase acti- 
vation is analyzed as a function of memory performance in 
the later test (subsequent memory paradigm), study- phase 
hippocampal and parahippocampal activations predicted sub- 
sequent memory for item with source as contextual details 
(Davachi et al. 2003; Ranganath et al. 2004; Sommer et al. 
2005; Peters et al. 2007), or for items "Remembered" in the 
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Remember/Know paradigm (Uncapher and Rugg 2005; 
Johnson and Rugg 2007; Otten 2007). The study-phase hippo- 
campal activation also predicts subsequent retrieval success 
with high confidence (Kim and Cabeza 2007), which is an 
indication of vivid remembering or recollection. Thus, we pre- 
dicted that the recollection of episodic details could be en- 
hanced by the prediction of rewards and punishments, and 
that the memory enhancement could be mediated by inter- 
actions between the hippocampal region associated with the 
successful encoding of memory details and the VTA/SN, NA, 
mOFC, and insular regions associated with the processing of 
rewards and/or punishments. 

To investigate our hypothesis, participants were scanned 
during the encoding of both words (item) and places where 
the words were presented (source) under 3 different con- 
ditions (Reward, Control, and Punishment; Fig. 1). Participants 
were rewarded or penalized in relation to their subsequent 
memory performance of item and source retrieval. On the 
basis of the aforementioned research, we made 3 predictions. 
First, VTA/SN, NA, and mOFC would be identified as common 
regions of activation in predicting both rewards and punish- 
ments, and the insula would show significant activations 
specific to the prediction of punishments. Second, activation 
in the hippocampus and PHC would increase as a function 
of subsequent retrieval performance of both item and 
source memories. Third, interaction between these reward/ 
punishment-related and memory-related hippocampal regions 
would be significant during the successful encoding of item 
and source memories. 



Materials and Methods 

Participants 

Thirty right-handed, college-aged participants (8 males and 22 
females; mean age 20.7 years; range 19-24 years) were recruited from 
the Tohoku University community and were paid for their partici- 
pation. All participants were healthy, native Japanese speakers, with 
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Figure 1. Experimental design of encoding and retrieval blocks, (a) During encoding, Japanese words were presented on the left or right side of the screen in 3 different font 
types. Participants were instructed to memorize the words (item) and on which side (left or right) they were presented (source) by judging font types. The cues indicated the 3 
different conditions (Reward, Punishment, and Control). Participants were told that they would be rewarded when they could remember item and/or source encoded in the 
Reward condition, and that they would be penalized when they could not remember item and/or source encoded in the Punishment condition in the subsequent retrieval blocks. 
(f>) During retrieval, old and new words were randomly presented in the center of the screen. Participants were required to judge whether the words had been previously 
presented and on which side they were presented during encoding. All labels were actually presented in Japanese. English is used here for illustration purposes only. 
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no history of neurological or psychiatric disorders. The data from 5 
participants were excluded from analyses because 2 fell asleep during 
fMRI scanning and 3 showed low memory performance, in which 1 
participant yielded higher false alarm rates than hit rates in item mem- 
ories and 2 produced higher false alarm rates than hit rates in source 
remembering. Thus, our analyses included 25 participants (5 males 
and 20 females; mean age 20.7 years; range 19-24 years). All partici- 
pants gave informed consent to a protocol approved by the Insti- 
tutional Review Board of Tohoku University School of Medicine. 

Experimental Tasks 

Experimental tasks in this study included encoding and retrieval 
phases, which were alternated across 6 blocks, each retrieval block 
testing memory encoded in the previous encoding block (i.e., 3 
encoding-retrieval sessions). Figure 1 illustrates examples of the 
stimuli in the encoding and retrieval phases. fMRI activations were 
measured in blocks of both encoding and retrieval, which were separ- 
ated by an approximately 1-min interval. In each block, our fMRI 
experiment was designed by an event-related procedure. In each trial 
during the encoding blocks, first, a cue which indicated the con- 
ditions of Reward (upward arrow), Control (vertical bar), or Punish- 
ment (downward arrow) was presented on the screen for 1500 ms. 
These conditions were randomly assigned to each of the encoding 
trials. After the presentation of the cue, a fixation interval was pre- 
sented for variable durations (jittered from 500 to 6500 ms), and then 
a Japanese word (Itsukushima et al. 1991) was presented for 1500 ms 
on the right or left side of the screen. In this phase, participants were 
required to encode the words (item) and the side (left or right) on 
which the words were presented (source) by judging the font types of 
target words. For the judgment of font types, 3 Japanese font types 
were prepared, and participants judged which font was the same as 
that of the target word in each case by pressing 1 of the 3 buttons 
(font types: HG gothic M, MS mincyo, and MOTOYA birchl). This 
task of font judgment was done to maintain the participants' attention 
on the target words. In this encoding phase of each block, partici- 
pants were required to learn 90 Japanese words and the side on 
which each word was presented. The 3 word lists, which were used 
in each condition of Reward, Control, and Punishment, were matched 
in terms of frequency, imagery, and concreteness scores and were 
counterbalanced across participants. 

During the retrieval phase of each block, participants were ran- 
domly presented with 90 learned and 45 new words one by one for 
3500 ms (interstimulus interval was jittered from 500 to 6500 ms) and 
were required to judge whether or not each word had been learned in 
the previous encoding block and, if the words were learned, which 
side, left or right, of the screen they had been shown on during the 
previous encoding block. Participants were rewarded if they could 
successfully retrieve item and/or source information of target words 
when they were encoded in the Reward condition (correct retrieval of 
item: +50 yen and correct retrieval of source: +50 yen for 1 trial). If 
participants failed to retrieve item and/or source information of the 
target words, which were encoded in the Punishment condition, they 
were penalized (incorrect retrieval of item: —50 yen and incorrect re- 
trieval of source: —50 yen for 1 trial). For words encoded in the 
Control condition, participants were neither rewarded nor penalized, 
whether or not they could remember item and/or source information 
of the target words. For new words, participants were rewarded for 
correct rejection responses and were penalized for false alarm 
responses (correct rejection: +66.7 yen and false alarm: —33-3 yen for 
1 trial). This process prevented the participants from relying on a 
strategy of obtaining rewards and avoiding punishments by pressing 
only the "old" buttons. Participants started the experimental tasks 
with 0 yen, and then earned or lost real money as reward or punish- 
ment according to their retrieval performance. 

fMRI Data Acquisition and Analysis 

All MRI data acquisition was conducted with a 3-T Philips Achieva 
scanner. Stimuli were visually presented through a projector and 
back-projected onto a screen. Participants viewed the stimuli via a 
mirror attached with the head coil of an MRI scanner. Behavioral 



responses were recorded using a 4-button fiber optic response box 
(Current Designs, Inc., Philadelphia, PA, USA). Scanner noise was 
reduced with earplugs, and head motion was minimized using foam 
pads and a headband. Anatomical scans began by first acquiring a 
7*,-weighted sagittal localizer series. Second, functional images were 
acquired utilizing echo-planar functional images (EPIs) sensitive to 
blood oxygenation level-dependent contrast [64 x 64 matrix, rep- 
etition time (TR) = 2000 ms, echo time (TE) = 30ms, flip angle = 70°, 
field of view (FOV) = 24 cm, 34 slices, 3-75 mm slice thickness]. 
Finally, high-resolution Zi-weighted structural images (magnetization 
prepared rapid acquisition with gradient echo, 240 x 240 matrix, 
TR = 6.5ms, TE = 3ms, FOV = 24cm, 162 slices, 1.0mm slice thick- 
ness) were collected. 

The preprocessing and statistical analyses for all images were per- 
formed using SPM5 (Wellcome Department of Cognitive Neurology, 
London, UK) implemented in Matlab (www.mathworks.com). In the 
preprocessing analysis, images were corrected for slice-timing and 
head motion, and then spatially normalized into the Montreal Neuro- 
logical Institute (MNI) EPI template. High-resolution 7*,-weighted 
structural images were not used in the spatial normalization process. 
After the spatial normalization, fMRI images were reformatted into 
isometric voxels (3. 75 x 3. 75 x 3. 75 mm), and spatially smoothed 
using a Gaussian kernel of 8-mm full-width at half-maximum. 

The fMRI analyses focused on data from the encoding phase in this 
study. Retrieval-related activations will be reported elsewhere. Statisti- 
cal fMRI analyses were performed first at the subject level and then at 
the group level. At the subject level, fixed-effect analyses were per- 
formed. Stimulus onsets, but not cue onsets, were modeled as delta 
functions convolved with a canonical hemodynamic response func- 
tion in the context of the general linear model (GLM). Confounding 
factors (head motion and magnetic field drift) were also included in 
the model. Activations associated with the prediction of reward/pun- 
ishment and with the subsequent memory (Paller and Wagner 2002) 
were identified using the parametric analyses with 2 independent 
models. In the case of reward/punishment-related activation, all 
encoding trials were divided into 3 conditions of Reward, Control, 
and Punishment. Reward-related increase of activation was identified 
with a linear regressor of reward-related increase (Reward: 3, Control: 
2, and Punishment: 1), whereas Punishment-related increase of acti- 
vation was identified with a reverse pattern of the linear regressor 
(Reward: 1, Control: 2, and Punishment: 3). Increasing activation 
associated with the processing of both reward and punishment was 
computed with a V-shaped regressor (Reward: 2, Control: 1, and 
Punishment: 2). These analyses yielded t-contrasts reflecting 
reward-related and/or punishment-related activations at the subject 
level. In the case of subsequent retrieval performance of item and 
source memories, all encoding trials were categorized into 3 con- 
ditions of the successful encoding of item with source (IWS), success- 
ful encoding of item only (IO), and missed encoding (ME). Previous 
studies have shown that the recollection-based responses are primar- 
ily associated with the highest level of perceived oldness, whereas the 
familiarity-based responses increase gradually as a function of per- 
ceived oldness (Yonelinas 2001; Yonelinas et al. 2002; Wixted and 
Stretch 2004). Thus, encoding-success activation associated with the 
successful retrieval of IWS was identified with a quasiexponential re- 
gressor (ME: 1, IO: 2, and IWS: 9), which was employed in the pre- 
vious fMRI studies (Daselaar et al. 2006; Tsukiura and Cabeza 2011). 
This analysis also yielded a t-contrast reflecting the subsequent retrie- 
val success of item and source memories at the subject level. 

At the group-level, random-effect analysis, by using contrast 
images from the subject-level, fixed-effect analyses, we conducted 
models of the 1-sample f-test for 3 contrasts of reward-/punishment- 
related activations, and for 1 contrast of encoding-success activations. 
To dissociate 3 patterns of activations associated with both reward 
and punishment, reward only, and punishment only, we employed a 
2-step analysis. First, activations reflecting functions of reward-related 
increase, punishment-related increase, and V-shaped increase for 
both reward and punishment were analyzed by three 1-sample f-tests, 
where we employed the threshold of P< 0.005 (uncorrected) with a 
minimum cluster size of 10 contiguous voxels. Second, to find acti- 
vations selective to reward or punishment, by using the exclusive 
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masking methods, we removed activations reflecting the V-shaped re- 
gressor from activations associated with linear increases for reward or 
punishment. In this analysis, we employed a threshold of P<0.01 as 
a masking contrast and a threshold of P< 0.005 (uncorrected) with a 
minimum cluster size of 10 contiguous voxels as masked contrast. 
The cluster size in these analyses corresponds to around P < 0. 1 for 
cluster extent corrections for multiple comparisons by the Monte 
Carlo simulations of spatially correlated data (https://www2.bc.edu/ 
sd-slotnick/scripts.htm). To avoid type I errors in activations, acti- 
vations in VTA/SN, NA, mOFC, and insula, which were defined as 
regions-of-interest (ROIs) based on previous studies, were corrected 
by the small volume correction (SVC) method (Worsley et al. 1996) 
with a sphere of 15 mm radius [P<0.05, family wise error (FWE) cor- 
rection]. The MNI coordinates of VTA/SN, NA, and mOFC ROIs were 
decided by previous functional neuroimaging studies investigating 
the reward-related enhancement of memory (left VTA: —4 —15 —12; 
right VTA: 5 -14 -10; left NA: -11 4 0; right NA: 10 3 -7; and left 
mOFC: -8 28 -26; Adcock et al. 2006; Shigemune et al. 2010). The 
insular ROI coordinates of MNI for the SVC procedure were defined 
by the previous functional neuroimaging studies investigating the acti- 
vation during anticipating monetary loss (left insular cortex: —45 —6 9 
and right insular cortex: 45 —6 15; Wrase et al. 2007). The coordinates 
reported by the Talairach space were transformed into the MNI space 
by the tal2mni tool (http://imaging.mrc-cbu.cam.ac.uk/downloads/ 
MNI2tal/tal2mni.m). This procedure provided us with 3 dissociable 
activation patterns associated with the processing of both reward and 
punishment, reward only, and punishment only. In addition, to 
examine whether activation in these reward-related and/or 
punishment-related regions was affected by a successful encoding 
factor, we extracted mean activations (effect sizes) during reward 
and/or punishment conditions from clusters identified in this analysis 
and compared them among 3 successful encoding conditions (IWS, 
IO, and ME) by a 1-way repeated-measure analysis of variance 
(ANOVA). 

To identify brain regions reflecting the subsequent retrieval 
success of memory for IWS information, a 1-sample f-test for contrasts 
of encoding-success activation was performed. In this analysis, we 
also employed the threshold of P< 0.005 (uncorrected) with a 
minimum cluster size of 10 contiguous voxels, which corresponds to 
around P < 0. 1 for cluster extent corrections for multiple comparisons 
by the Monte Carlo simulations of spatially correlated data (https:// 
www2.bc.edu/sd-slotnick/scripts.htm). In addition, on the basis of an 
a priori hypothesis, we employed a more lenient threshold of 
P< 0.005 with a minimum cluster size of 3 voxels within the hippo- 
campus and PHC, which were defined as ROIs by the WFU PickAtlas 
(http://www.fmri.wfubmc.edu) and the AAL ROI package (Tzourio- 
Mazoyer et al. 2002). To avoid type I errors in activations, activations 
identified in these ROIs were corrected by the SVC method with a 
sphere of 15 mm radius (P<0.05, FWE correction), in which the MNI 
coordinates of a center voxel (left hippocampus: —20 —11 —21; right 
hippocampus: 21 —12 —22; right entorhinal cortex: 20 —10 —33; and 
left PHC: -34 -43 -8) were defined by a previous fMRI study 
(Adcock et al. 2006). Original coordinates in the Talairach space were 
transformed into the MNI space by the tal2mni tool (http://imaging. 
mrc-cbu.cam.ac.uk/downloads/MNI2tal/tal2mni.m). Mean activations 
(effect sizes) of Reward, Control, and Punishment conditions during 
IWS, which were extracted from the hippocampal and PHC clusters 
identified in this analysis, were also analyzed by a 1-way repeated- 
measures ANOVA with a factor of reward/punishment (Reward, 
Control, and Punishment). In this ANOVA analysis, we investigated 
whether activation in memory-related regions was also modulated by 
the effect of reward/punishment during encoding. 

To examine the interaction between reward-/punishment-related 
and memory-related regions, which were identified in the prior ana- 
lyses, we conducted a 2-step correlation analysis between activations 
in these regions across participants. In this analysis, during the suc- 
cessful encoding of IWS memories, we examined how reward-/ 
punishment-related regions were functionally interacted to 
memory-related regions, because we hypothesized that memory en- 
hancement by rewards and punishments could be observed only in 



recollection, not in familiarity, and that interactions between reward-/ 
punishment-related and recollection-related regions could contribute 
to the memory enhancement by rewards and punishments. First, 
we defined activation clusters identified in both the reward-/ 
punishment-related and recollection-related analyses as ROIs, from 
which mean activations (effect sizes) were extracted during IWS in all 
participants. Second, by using the values of activations in IWS con- 
ditions, we computed the Pearson correlations between these ROIs, 
and then examined whether or not the correlation coefficients if) 
were significant in each correlation. 

Moreover, to examine whether correlations between reward-/ 
punishment-related and memory-related regions during the successful 
encoding of IWS memories are modulated separately by the effects of 
rewards or punishments during encoding, we performed additional 
correlation analyses with 2 steps. First, we extracted mean activations 
(effect sizes) from ROIs, which were defined as an activation cluster 
in the 2 models of parametric modulation analysis, in each condition 
of Reward, Punishment, and Control during IWS by each participant. 
Second, using the values of activations in each condition of Reward, 
Punishment, and Control during IWS, we computed the Pearson cor- 
relation coefficients between reward-/punishment-related and memory- 
related ROIs separately in these conditions, and then examined 
whether or not the correlation coefficients (r) across participants 
were significant in each condition. Previous neuroimaging studies 
investigating the effects of emotion on episodic memory have em- 
ployed similar correlation analysis and have shown a potential inter- 
action between emotion-related regions such as the amygdala and 
memory-related regions such as the hippocampus (Dolcos et al. 2004; 
Richardson et al. 2004). 

To further investigate interactions between memory-related and 
reward/punishment-related regions in each condition of Reward, Pun- 
ishment, and Control during IWS, we employed a 3-step correlation 
analysis based on individual trial activations (Rissman et al. 2004; 
Daselaar et al. 2006; Ritchey et al. 2008; St Jacques et al. 2009). First, 
we created a GLM, in which each individual trial was modeled by a 
separate covariate. This yielded different parameter estimates for each 
individual trial in each individual participant. Second, parameter esti- 
mates from the seed voxels of the hippocampus and PHC, which 
were identified in our parametric modulation analysis, were correlated 
with trial-by-trial parameter estimates from all other voxels, and then 
contrast images reflecting correlation patterns related to each seed 
voxel of the hippocampus and PHC for each trial type (Reward, Pun- 
ishment, and Control in IWS) were generated in individual partici- 
pants. Finally, to investigate the effects of reward/punishment and 
memory-related region factors on correlation patterns associated with 
the seed voxels, using the contrast images reflecting correlations in 
each participant, we conducted a 2-way repeated-measures ANOVA 
with the factors of reward/punishment (Reward, Control, and Punish- 
ment) and memory-related region (hippocampus and PHC). 

In this analysis, first, to identify regions showing higher correlation 
in both Reward and Punishment than in Control, a main effect 
(F-contrast) of reward/punishment was masked inclusively with 2 t- 
contrasts of Reward versus Control and Punishment versus Control. 
Similarly, to identify regions showing higher correlation in Reward 
than in Punishment and Control, a main effect (F-contrast) of reward/ 
punishment was masked inclusively with 2 t-contrasts of Reward 
versus Control and Reward versus Punishment, whereas regions 
related to higher correlation selectively in Punishment were identified 
in a main effect (F-contrast) of reward/punishment masked in- 
clusively with 2 t-contrasts of Punishment versus Control and Punish- 
ment versus Reward. Second, we explored regions showing 
higher correlation associated with the hippocampus than with the 
PHC. This analysis was performed in the main effect (F-contrast) of 
memory-related region masked inclusively with a t-contrast of hippo- 
campus versus PHC. Third, to identify regions showing both 
reward-related and punishment-related enhancement of correlation 
only with the hippocampus, an interaction (F-contrast) between 
reward/punishment factor and memory-related region factor was 
masked inclusively with 2 t-contrasts of Reward versus Control and 
Punishment versus Control in the hippocampus-related correlations. 
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Regions reflecting a reward-related increase of correlation with the 
hippocampus only were analyzed in an interaction (F-contrast) 
between the 2 factors masked inclusively with 2 t-contrasts of Reward 
versus Control and Reward versus Punishment in the hippocampal 
correlations, whereas regions related to punishment-related increase 
of correlation with the hippocampus only were identified in an 
interaction (F-contrast) between the 2 factors masked inclusively with 
2 t-contrasts of Punishment versus Control and Punishment versus 
Reward in the hippocampal correlations. Statistical thresholds were 
set in P<0.05 for both F-contrasts (uncorrected with a minimum 
cluster size of 2 contiguous voxels) and t-contrasts. Regions showing 
a significant correlation were masked with ROIs as a sphere of 15 mm 
radius, in which the coordinates of center voxels were defined in our 
results (right VTA/SN: 8 -11 -8; right NA: 11 8 -15; and insula: 45 0 
19), or in previous studies (left VTA: -4 -15 -12; right VTA: 5 -14 
-10; left NA: -11 4 0; right NA: 10 3 -7; left mOFC: -8 28 -26; left 
insular cortex: —45 —6 9; and right insular cortex: 45 —6 15; Adcock 
et al. 2006; Wrase et al. 2007; Shigemune et al. 2010). The SVC for 
these regions showing significant correlations was performed with a 
sphere of 15 mm radius with center at the coordinate of peak voxel 
(P<0.05). 



Mean accuracy (%) 




Figure 2. Mean proportion of retrieval accuracy for both the IWS and 10 memories 
in the Reward, Punishment, and Control conditions. Error bars represent standard 
error. *P < 0.05. 



Results 

Behavioral Results 

Table 1 shows accuracy in the retrieval phase and response 
times (RTs) in the encoding and retrieval phases. The appli- 
cation of reward and punishment during encoding enhanced 
the retrieval accuracy of IWS memories, but this enhancement 
was not found in the retrieval of IO memories. A 2-way 
repeated-measures ANOVA, which included 2 factors of 
reward/punishment (Reward, Control, and Punishment) and 
memory performance (IWS and IO), demonstrated significant 
main effects of reward/punishment {F 2 ,4s = 6.23, P< 0.01) and 
memory performance (i%24 = 63.44, P<0.QV), and a signifi- 
cant interaction between the 2 factors (^2,48 = 6.93, P<0.01). 
Post hoc tests showed a significant difference in accuracy 
between Reward and Control (P<0.05), and Punishment and 
Control (P< 0.05) in the IWS condition, but not in the IO con- 
dition (Fig. 2). This finding is consistent with our assumption 
that the enhancing effect of reward and/or punishment on 
memory is mediated by the retrieval of memory details or 
recollection. 



Table 1 

Behavioral results 





IWS 


10 




ME 


Number of trials 










Reward 


47.5 |2.6) 


18.7 


(1.8) 


18.7 (1.8) 


Control 


41.9 (2.9) 


20.0 


[1.8| 


23.5 (2.5) 


Punishment 


50.0 (3.0) 


17.6 


(1.5) 


17.8 (1.8) 


Proportion of trials (%) 










Reward 


55.8 (2.9) 


22.0 


(2.0) 


24.4 (2.4) 


Control 


48.9 (3.3) 


23.4 


(2.1) 


26.5 (2.5) 


Punishment 


58.0 (3.1) 


20.7 


[1.8| 


23.9 (2.6) 


RT during encoding (ms) 










Reward 


1204.1 (22.2) 


1202.3 


(28.7) 


1214.3 (24.9) 


Control 


1212.1 (23.3) 


1191.7 


(24.9) 


1210.7 (27.8) 


Punishment 


1213.0 (24.0) 


1203.1 


(23.6) 


1204.2 (25.8) 


RT during retrieval (ms] 










Reward 


1553.2 (50.6) 


1867.7 


(77.0) 


1794.5 (79.0) 


Control 


1615.6 (57.5) 


1910.3 


(77.8) 


1773.4 (59.0) 


Punishment 


1556.2 (53.2) 


1890.7 


(74.3) 


1764.5 (74.6) 



All values are mean (SE). 

IWS, item with source; 10, item only; ME, missed encoding. 



RTs in the encoding and retrieval phases were compared 
by 2-way ANOVAs with 2 factors of reward/punishment 
(Reward, Control, and Punishment) and memory performance 
(IWS and IO). In the encoding phase, this analysis showed no 
significant main effect of each factor (reward/punishment: 
^2,48 = 0.23, P = 0.80 and memory performance: F 12 4 = 1.19, 
P=0.29} and no significant interaction between the 2 factors 
CF 2 48 = 0.4l, ^=0.67). In the retrieval phase, this analysis 
showed a significant main effect of memory performance 
(^1,24 = 45.67, P<0.01), but a main effect of reward/punish- 
ment (^2,48 = 2.65, P=0.08) and interaction between the 2 
factors (F 2 ,48 = 0.24, P = 0.79) was not significant. 

fMRI Results 

Confirming our first prediction, activations in the right VTA/ 
SN and right NA were greater in the Reward and Punishment 
conditions than in the Control condition (Fig. 3). Significant 
activations in these regions were confirmed by the SVC pro- 
cedures. As shown in Table 2, other regions showing greater 
activation during the predictions of both reward and punish- 
ment were also identified in the left inferior frontal, precen- 
tral, and middle temporal, globus pallidus regions and the 
right inferior occipital gyrus. In addition, the right insular 
cortex was identified as a punishment-selective region, where 
the activation increased as a linear function of punishment 
(Fig. 3). This activation was still significant after applying the 
SVC procedure. As shown in Table 3, reward-selective regions 
were also found in several regions, including the anterior cin- 
gulate gyrus, supplementary motor area, cuneus, claustrum, 
fornix, and cerebellum. In addition, using 1-way repeated- 
measures ANOVAs, we examined whether the right VTA/SN, 
right NA, and right insular activations identified in this analy- 
sis were also affected by a factor of successful encoding (IWS, 
IO, and ME). In this analysis, these regions showed no signifi- 
cant effect of the successful encoding factor (right VTA/SN: 
^2,24 = 0.59, P=0.56; right NA: F 2M = 2.01, P=0.l6; and right 
insular cortex: F 224 = 0.78, P= 0.47). 

Confirming our second prediction, activation in the right 
hippocampus and left PHC during encoding predicted the 
subsequent retrieval success of source memories (Fig. 4). 
These activations were still significant after the SVC 
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Figure 3. Activation images and activation profiles in reward-/punishment-related 
regions. Regions associated with both rewards and punishments were identified in 
the right VTA/SN and right NA regions. The right insular activation reflected a linearly 
increasing function of punishment. The numbers of each point show the mean effect 
size (SE) in each condition. 



Table 2 

Regions associated with both reward and punishment 



Regions 


L/R 


BA 


Z-score 


Coordinates 
x y 


z 


Nucleus accumbens 


R 




3.45 


11 


8 


-15 


Ventral tegmental area/substantia nigra 


R 




3.38 


8 


-11 


-8 


Inferior frontal gyrus 


L 


47 


3.57 


-30 


34 


0 


Inferior frontal gyrus 


L 


44 


2.87 


-56 


8 


19 


Precentral gyrus 


L 


6 


3.31 


-15 


-11 


63 


Middle temporal gyrus 


L 


20 


3.75 


-64 


-41 


-11 


Middle temporal gyrus 


L 


39 


2.98 


-41 


-64 


23 


Inferior occipital gyrus 


R 


18 


3.40 


30 


-90 


-8 


Globus pallidus 


L 




3.50 


-15 


-4 


4 


Globus pallidus 


L 




3.65 


-15 


-15 


-8 



BA, Brodmann area; L, left; R, right. 



Table 3 

Reward-selective and punishment-selective regions 



Regions 


W 


BA 


Z-score 


Coordinates 

X 


y 


z 


Reward-selective regions 














Anterior cingulate gyrus 


R 


11 


3.40 


11 


41 


4 


Supplementary motor area 


R 


6 


3.11 


15 


-23 


53 


Cuneus 


R 


17 


3.02 


15 


-105 


0 


Claustrum 


L 




3.15 


-26 


-8 


-15 


Fornix 


LR 




3.63 


-4 


0 


15 


Cerebellar vermis 


R 




3.19 


4 


-34 


-11 


Cerebellar hemisphere 


L 




2.77 


-8 


-60 


-34 


Punishment-selective regions 














Insula 


R 


48 


3.28 


45 


0 


19 



BA, Brodmann area; L, left; R, right. 

procedures. However, the right PHC activation was not sig- 
nificant under the SVC procedures. As shown in Table 4, 
other regions reflecting a quasiexponential function for the 
subsequent retrieval success of source memories were ident- 
ified in the lateral and medial prefrontal regions, lateral tem- 
poral, parietal, and occipital regions, basal ganglia, and 




Memory-related regions 




Figure 4. Activation images and activation profiles in encoding-related regions 
predicting successful retrieval of IWS memories. The right hippocampus and left PHC 
regions showed increasing activation associated with the subsequently successful 
retrieval of IWS memories. IWS: successful encoding of item with source memories, 
10: successful encoding of 10 memories, ME: missed encoding of memories. The 
numbers of each point show the mean effect size (SE) in each condition. 



Table 4 

Regions showing a parametric effect of subsequent memory 



Regions 


UP, 


BA 


Z-score 


Coordinates 
x y 


z 


Memory-related regions (predicted regions] 












Hippocampus 


R 




3.30 


30 


-15 


-11 


Parahippocampal cortex 


R 




3.21 


26 


-26 


-26 


Parahippocampal cortex 


L 




3.11 


-26 


-38 


-15 


Memory-related regions (other regions) 












Hippocampus 


R 




3.30 


30 


-15 


-11 


Parahippocampal cortex 


L 




3.27 


-19 


-41 


-15 


Parahippocampal cortex 


R 




3.14 


19 


-8 


-30 


Middle frontal gyrus 


L 


46 


2.87 


-38 


56 


11 


Inferior frontal gyrus 


R 


45 


3.79 


53 


26 


19 


Inferior frontal gyrus 


L 


45 


5.50 


-56 


23 


26 


Precentral gyrus 


L 


6 


3.45 


-23 


-23 


60 


Supplementary motor area 


R 


6 


2.97 


19 


-19 


53 


Medial orbitofrontal cortex 


R 


11 


2.77 


15 


26 


-11 


Paracentral lobules 


L 


4 


3.17 


-15 


-38 


64 


Supplementary motor area 


L 


6 


3.67 


-4 


15 


53 


Supplementary motor area 


L 


6 


3.06 


-4 


-4 


53 


Cingulate gyrus (middle part) 


R 


24 


3.74 


8 


4 


30 


Temporal pole 


R 


38 


3.65 


49 


11 


-26 


Middle temporal gyrus 


L 


21 


2.66 


-60 


-23 


-8 


Middle temporal gyrus 


R 


21 


2.77 


53 


-26 


-4 


Middle temporal gyrus 


R 


21 


2.79 


41 


-68 


15 


Middle temporal gyrus 


L 


21 


3.39 


-41 


-49 


11 


Inferior temporal gyrus 


L 


20 


4.83 


-60 


-38 


-15 


Inferior parietal lobule 


L 


40 


4.23 


-38 


-38 


41 


Middle occipital gyrus 


L 


19 


5.15 


-34 


-79 


34 


Caudate nucleus 


R 




3.48 


23 


-4 


19 


Putamen 


R 




3.41 


23 


15 


11 


Cerebellar hemisphere 


L 




3.26 


-26 


-34 


-30 



BA, Brodmann area; L, left; R, right. 



cerebellum. In addition, we investigated whether activations 
in the right hippocampus and left PHC identified in this 
analysis were modulated by a factor of reward/punishment 
(Reward, Control, and Punishment) by 1-way repeated- 
measures ANOVAs. In these analyses, the right hippocampus 
demonstrated a significant effect of the reward/punishment 
factor, where there were significant differences in activations 
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Figure 5. Correlation patterns between activations in the reward-/punishment-related and memory-related hippocampal regions and activation pattern in the hippocampal region, 
(a) Correlations between the reward-/punishment-related VTA and NA regions and the memory-related hippocampal region, {b) Correlation between the punishment-related 
insular and the memory-related hippocampal regions. Gray lines represent significant correlations between reward-/punishment-related and memory-related hippocampal regions 
[P < 0.05). (c) Right hippocampal activation, which reflected the successful encoding of IWS memories, was also affected by a reward/punishment factor, where the activation 
was greater during the successful encoding of IWS memories under the Reward and Punishment conditions than the Control condition. Error bars represent standard errors. 
*P < 0.05. 



between Reward and Control (P<0.05), and Punishment and 
Control (P<0.05; ^,24=3.44, P<0.05, Fig. 5). The left PHC 
showed no significant effect of the reward/punishment factor 
0=2,24 = 3.04, P= 0.07). 

Confirming our third prediction, memory-related hippo- 
campal activation was significantly correlated with activation 
in reward-related and/or punishment-related regions across 
participants (Fig. 5). Activation in the right hippocampus as 
IWS memory-related region showed significant correlations 
with that in the right VTA/SN and right NA as common 
regions between reward and punishment (right VTA/SN: 
r=0.60, /><0.05 and right NA: r=0.6l, P<0.05), and that in 
the right insula as punishment-selective region (r=0. 54, 
P<0.05) in the IWS condition. The left PHC identified as an 
IWS memory-related region showed significant correlations 
with the right NA as common regions between reward and 
punishment (right NA: r=0.60, P<0.05) and with the right 
insula as a punishment-selective region (r=0.49, i-"<0.05) in 
the IWS condition. However, correlation patterns observed in 
the left PHC region were affected by one potential outlier. 
After removing the data of this outlier, no significant corre- 
lation was found between these regions (right NA: r=0.36, 
P> 0.1 and right insula: r= 0.04, P> 0.1). The correlation coef- 
ficient between the left PHC and right VTA/SN was not signifi- 
cant (P> 0.1) in the IWS condition. 



To investigate further whether correlations between 
memory-related hippocampus and reward-/punishment- 
related regions were modulated by the effects of rewards and/ 
or punishments during the successful encoding of IWS mem- 
ories, we performed additional correlation analyses separately 
in each condition of Reward, Punishment, and Control during 
IWS across participants. In all conditions of Reward, Punish- 
ment, and Control, activations in the right hippocampus were 
significantly correlated with those in the right NA (Reward: 
r=0.74, ,P<0.05; Punishment: r = 0.44, P<0.05; and Control: 
r=0.70, P<0.05) and with those in the right insula (Reward: 
r=0.50, ,P<0.05; Punishment: r = 0.4l, P<0.05; and Control: 
r=0.53, P<0.05). Correlation coefficients between the right 
hippocampus and right VTA/SN were significant in Reward 
(r=0.67, P<0.05) and Control (Control: r=0.76, P<0.05), 
but not in Punishment (r=0.33, P=0.11). These findings 
suggest that the correlation patterns identified in the original 
analyses could be almost replicated even when conditions of 
Reward, Punishment, and Control were separately analyzed. 

Additionally, correlation analyses based on individual trial 
activations demonstrated that the hippocampus showed a 
higher correlation with either reward-related or punishment- 
related regions than the PHC during the successful encoding 
of IWS memories. However, these patterns of correlations 
were not significant during the unsuccessful encoding of IWS 
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Table 5 

Regions identified in the functional connectivity analysis 

Regions L/R Z-score Coordinates 



x y z 

ROIs defined in our results 



Main effect of region 



Nucleus accumbens 


L 


2.90 


-4 


8 


-15 


Ventral tegmental area 


R 


2.26 


19 


-23 


-8 


Ventral tegmental area 


R 


2.70 


8 


-8 


-8 


Ventral tegmental area 3 


R 


2.11 


4 


-8 


8 


Insula 


R 


1.84 


38 


-4 


23 



Main effect of reward/punishment 

No significant activation 
Interaction between region and reward/punishment 

No significant activation 
ROIs defined in previous studies 



Main effect of region 



Nucleus accumbens b 


L 


3.26 


-11 


4 


15 


Nucleus accumbens 


L 


2.90 


-4 


8 


-15 


Nucleus accumbens 


R 


2.66 


0 


8 


-11 


Ventral tegmental area 


R 


1.96 


15 


-19 


-8 


Ventral tegmental area 


R 


2.70 


8 


-8 


-8 


Ventral tegmental area 


R 


2.24 


0 


-11 


8 


Insula 


L 


2.60 


-41 


8 


15 


Insula 


R 


1.84 


38 


-4 


23 



Main effect of reward/punishment 

No significant activation 
Interaction between region and reward/punishment 

No significant activation 



Note. Regions labeled with (a) or (b) included a part of the thalamus (a) and the caudate nucleus 
(b). However, these regions were not survived after the SVC method. 
L, left; R, right. 

memories (i.e., IO memories). As shown in Table 5, a main 
effect of memory-related region in a 2-way repeated-measures 
ANOVA for correlations during IWS showed that individual 
trial activations in the VTA/SN, NA, and insular cortex were 
more highly correlated with hippocampal activations than 
with PHC activations. We confirmed that the correlation pat- 
terns were identified in the left NA (-4, 8 -15), right VTA (8, 
—8, —8), and right insula (38, —4, 23) after applying the SVC 
methods. However, we did not find significant activations of 
any regions in a main effect of reward/punishment, and an 
interaction between the 2 factors of memory-related region 
and reward/punishment. To further investigate whether the 
correlation patterns identified in a main effect of 
memory-related region (hippocampus and PHC) were ob- 
served in the unsuccessful encoding of IWS memories (i.e., 
IO memories), we compared hippocampal-related corre- 
lations with PHC-related correlations in the same ROIs during 
IO. This analysis showed no significant correlation in any 
ROIs after the SVC methods. These results also confirmed the 
correlation patterns identified in the original correlation 
analysis. Results of trial-by-trial correlation analyses are sum- 
marized in Table 5. 



Discussion 

Three main findings emerged from the current study. First, 
activation in the VTA/SN and NA was greater for both con- 
ditions of Reward and Punishment than for Control, and acti- 
vation in the insula selectively increased as a linear function 
of punishment. Second, activation in the hippocampus and 
PHC during encoding predicted the subsequent retrieval 
success of IWS memories. Third, correlations between acti- 
vations in the hippocampus as an IWS memory-related and 



reward/punishment-related regions, including VTA/SN, NA, 
and insula, were significant during the successful encoding of 
IWS memories, and the hippocampal activation, which re- 
flected the subsequent recollection process, was affected by a 
factor of reward/punishment during encoding. However, the 
IWS memory-related PHC activation, where a significant effect 
of the reward/punishment factor was not identified by 
ANOVA, showed no significant correlation with any reward/ 
punishment-related regions. These 3 findings are discussed 
separately below. 

Reward-/Punishtnent-Related Regions 

The first main finding of our study was that the VTA/SN and 
NA regions showed increasing activation for predicting both 
rewards and punishments, and that activation in the insular 
cortex reflected a linearly increasing function for predicting 
punishments only. These findings suggest that the VTA/SN 
and NA regions could contribute to the prediction of both 
monetary rewards and punishments during memory encod- 
ing, and that the insular cortex could be involved in the pre- 
diction of monetary punishments during memory encoding. 

The involvement of VTA and NA in the prediction of mon- 
etary rewards is consistent with neuroscientific evidence that 
reward-related information is processed in the dopaminergic 
pathway, where the dopaminergic neurons in the VTA regions 
are projected to the NA and mOFC regions (Olds and Milner 
1954; Haber and Knutson 2010). Previous neurophysiological 
studies suggest that the dopaminergic neurons could code the 
prediction and prediction errors of rewards, and that the pre- 
diction and prediction errors of rewards could reinforce the 
approaching behaviors to rewards (Schultz et al. 1997; Schultz 
1998). The VTA/SN and NA activations identified in the 
present study could reflect the prediction of reward-related 
information and could contribute to the generation of ap- 
proaching behaviors to rewards. 

One possible explanation for VTA/SN and NA activations in 
our study is the difference between primary and secondary 
rewards. For example, one fMRI study reported that NA acti- 
vations were associated only with the processing of primary 
rewards (Beck et al. 2010), whereas another fMRI study 
showed significant NA activations during the processing of 
secondary rewards (Valentin and O'Doherty 2009). There is 
also fMRI evidence linking NA activations to coding the 
values of both primary and secondary rewards (Sescousse 
et al. 2010). These findings suggest that NA responses could 
not be modulated by the difference of primary and secondary 
rewards. A number of functional neuroimaging studies have 
demonstrated that the VTA/SN and NA codes the prediction 
and prediction errors of monetary rewards (Knutson, Adams, 
et al. 2001; Knutson, Fong, et al. 2001; Dreher et al. 2006; 
D'Ardenne et al. 2008; Staudinger et al. 2009; Valentin and 
O'Doherty 2009; Sescousse et al. 2010), which are consistent 
with our findings. Although further investigations are re- 
quired to confirm whether the primary or secondary reward 
is more important in VTA/SN and NA activations, it is possible 
that VTA/SN and NA regions could be modulated by second- 
ary rewards, or money. 

In the present study, the mOFC region showed no increas- 
ing activation associated with the prediction of rewards. The 
absence of mOFC activation is inconsistent with previous 
functional neuroimaging studies linking this region to the 
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prediction of rewards (O'Doherty, Critchley, et al. 2003; Cox 
et al. 2005; Hare et al. 2008; Bray et al. 2010). The difference 
in mOFC activation may be explained by low magnitude of 
rewards and greater demands of memory. Previous studies 
have reported increasing mOFC activation associated with 
magnitude of rewards and subjective pleasantness of rewards, 
suggesting that the mOFC region could code subjective 
reward values (O'Doherty et al. 2001; Kringelbach et al. 2003; 
O'Doherty, Winston, et al. 2003; Galvan et al. 2005). In our 
previous study (Shigemune et al. 2010), using almost the 
same paradigm as that used in the present study, we investi- 
gated the effects of monetary rewards on encoding-related 
activations and found greater mOFC activations during the en- 
coding of pictures with high rewards than with low rewards. 
However, the magnitude of monetary rewards employed in 
our previous study was greater than that in the current study, 
and the memory demands were lower than those in the 
current study. Thus, the absence of mOFC activation in the 
current study could be caused by the attenuation of subjective 
rewarding values due to greater memory demands. 

VTA/SN and NA also showed greater activation during the 
prediction of monetary punishments. This result is consistent 
with functional neuroimaging evidence, which demonstrated 
significant activations in the VTA/SN and NA regions during 
predictions of both rewards and punishments (Knutson et al. 
2000; Samanez-Larkin et al. 2007; Wrase et al. 2007; Carter 
et al. 2009; Delgado et al. 2011). The responses of VTA/SN 
and NA regions to the prediction of punishments may be ex- 
plained by the concept that avoidance of punishments may be 
processed as the obtainment of rewards (Kim et al. 2006). For 
example, one fMRI study demonstrated that VTA/SN and NA 
regions showed significant activations during the anticipation 
of punishments, but not during the acceptance of punish- 
ments (Bjork et al. 2010). This result could reflect worry by 
participants when they anticipate subsequent punishments 
about accepting those punishments as well an expectation of 
being able to avoid punishments. 

Another fMRI study reported that NA activation was ident- 
ified in the uncertain situation, where it is possible to avoid 
punishments, but activation in this region was not found in 
the situation in which there is no possibility of avoiding pun- 
ishments (Cooper and Knutson 2008). In addition, there is 
functional neuroimaging evidence that the ventral striatum 
region showed decreasing activations in the processing of loss 
outcome (Delgado et al. 2000), and that the VTA/SN and NA 
regions were not involved in the processing of 
negative-reward information (Liu et al. 2007). Given that par- 
ticipants in the present study could avoid monetary punish- 
ments if they successfully remembered item and source 
memories encoded in the Punishment condition, and that the 
motivation for avoiding subsequent punishments could 
enhance the encoding process of IWS memories, the present 
findings of VTA/SN and NA activations could reflect the pre- 
diction of the possible avoidance of punishments rather than 
the acceptance of punishment outcomes. The prediction of 
avoiding possible punishments, which leads to total gain, 
may be processed as the prediction of rewards. However, 
further investigations would be required to clarify whether 
VTA/SN and NA activations are associated either with the pre- 
diction of avoiding punishments or with that of accepting 
punishments. 



There are some electrophysiological studies in which 
responses in dopaminergic neurons are enhanced only by 
rewards, not by punishments (Ljungberg et al. 1992; Schultz 
1998; Guarraci and Kapp 1999; Coizet et al. 2006), whereas 
other studies have reported that VTA includes 2 types of 
neurons, one of which is inhibited by punishments and the 
other is excited by punishments (Ungless et al. 2004; Matsu- 
moto and Hikosaka 2009). The inconsistent results could 
possibly be explained by dissociable roles between excitable 
dorsolateral and inhibitable ventromedial VTAs (Matsumoto 
and Hikosaka 2009). In the present study, we found ventro- 
medial VTA/SN activations associated with the motivation of 
both receiving rewards and avoiding punishments. These 
findings also support the interpretation that the present find- 
ings of VTA/SN and NA activations could reflect the possible 
avoidance of punishments, which are processed as the predic- 
tion of receiving rewards, rather than the general process of 
punishments, which could be involved in the dorsolateral 
VTA regions. 

In the present study, we did not find amygdala activations 
associated with the prediction of both rewards and punish- 
ments. This finding is inconsistent with previous cognitive 
neuroscience studies involving experimental animals and 
human subjects, where the amygdala showed increasing acti- 
vations in fear conditioning, aversive learning, appetitive 
learning, and memory motivated by punishments (Dolan 
2000; Everitt et al. 2000; Gallagher 2000; LeDoux 2000; Murty 
et al. 2012). The lack of amygdala activations in our study 
could have 3 possible explanations. The first possible expla- 
nation is that the arousal of monetary rewards and punish- 
ments in our study may not be enough to give rise to 
significant activations in the amygdala. Functional neuroima- 
ging studies have shown that the amygdala is involved in 
coding emotional arousal rather than emotional valence, and 
that amygdala activation is greater in the processing of high 
arousal stimuli than that of low arousal stimuli (Anderson 
et al. 2003; Small et al. 2003; Kensinger 2004; Lewis et al. 
2007). In the present study, the outcome, that is, whether par- 
ticipants received rewards or avoided punishments in the sub- 
sequent retrieval phase, was uncertain in the encoding phase. 
This uncertainty may be the reason why there is no significant 
activation in the amygdala. The second possible explanation 
is the difference in incentive types between primary and sec- 
ondary rewards/punishments. For example, one fMRI study 
reported that the amygdala showed significant activations 
associated with aversive conditioning by primary punish- 
ments such as electrical shock, but not by secondary punish- 
ments such as monetary loss (Delgado et al. 2011). Another 
fMRI study demonstrated that amygdala activation provoked 
by electrical shock was associated with the memory enhance- 
ment by punishments (Murty et al. 2012). However, there are 
other neuroimaging studies, indicating that activations in the 
amygdala are enhanced by monetary loss as secondary pun- 
ishments (Breiter et al. 2001; Yacubian et al. 2006; Smith et al. 
2009). Thus, further investigations would be required to 
clarify whether activations in the amygdala are affected by the 
difference between primary and secondary rewards/punish- 
ments. The third possible explanation is that the amygdala is 
involved in reward-motivated or punishment-motivated learn- 
ing, but not in the episodic memory processes motivated by 
rewards or punishments. Functional neuroimaging studies 
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have consistently shown no amygdala activations associated 
with the episodic memory processes motivated by rewards 
(Wittmann et al. 2005; Adcock et al. 2006; Tsukiura and 
Cabeza 2008; Wittmann et al. 2008; Shigemune et al. 2010; 
Tsukiura and Cabeza 2011). However, this account is not a 
sufficient basis on which to interpret the absence of amygdala 
activation in our study, because memory enhancement for 
emotional stimuli is modulated by amygdala-hippocampus 
interactions (Hamann et al. 1999; Dolcos et al. 2004), because 
amygdala activations aroused by positive emotion have a ben- 
eficial effect on memory enhancement by rewards (Wittmann 
et al. 2008), and amygdala activations aroused by negative 
emotion also contributes to memory enhancement by punish- 
ments using electrical shocks (Murty et al. 2012). Thus, the 
lack of amygdala activations in our study cannot simply be ex- 
plained by in terms of a learning-episodic memory 
distinction. 

Activation in the insular cortex reflected a linearly increas- 
ing function for punishment. This finding of insular acti- 
vations is consistent with functional neuroimaging evidence 
linking this region to the processing of pain (Coghill et al. 
1994; Ploghaus et al. 1999) or disgust (Phillips et al. 1997; 
Wicker et al. 2003; Nitschke et al. 2006). Roles of the insular 
cortex have also been identified in the processing of sub- 
sequent avoidance behaviors (Knutson and Greer 2008). The 
present finding of insular activation associated with the motiv- 
ation of avoiding punishments could reflect the prediction of 
receiving punishments, which could make us avoid punish- 
ments. Therefore, the VTA/SN and NA regions could predict 
avoiding punishments as though it was the same as getting 
rewards, whereas the insular cortex as a punishment-selective 
region could contribute to the prediction of aversion to the 
perceived punishments and of behavior to be avoided. 

Memory-Related Regions 

The second main finding of our study was that activation in 
the hippocampus and PHC during encoding reflected a func- 
tion of the subsequent retrieval success of item and source 
memories. The finding that the hippocampus and PHC 
showed the highest activation in IWS suggests that these 
regions could predict the subsequent recollection or retrieval 
of memory details including item and contextual information 
of an event. 

The importance of the hippocampus and PHC in the suc- 
cessful encoding of item and source memories is consistent 
with functional neuroimaging evidence that activation in 
these regions during encoding reflected either the subsequent 
recollection of memories or the subsequent retrieval of IWS 
memories (Davachi et al. 2003; Ranganath et al. 2004; Weis 
et al. 2004; Daselaar et al. 2006; Kensinger and Schacter 2006; 
Montaldi et al. 2006; Uncapher et al. 2006; Wais 2008). Given 
that the human memory system could be divided into 2 inde- 
pendent processes, recollection and familiarity (Jacoby 1991; 
Yonelinas 2002), the finding of hippocampal and PHC acti- 
vation could contribute to the subsequent retrieval of memory 
details, but not to the retrieval of memory items only. In 
addition, recent review studies have implied that the hippo- 
campus could be involved in the association processes 
between item and source information, whereas the PHC 
region could contribute to the processing of source or contex- 
tual information (Davachi 2006; Diana et al. 2007; 



Eichenbaum et al. 2007; Mitchell and Johnson 2009). Acti- 
vation in the hippocampus and PHC identified in the present 
study could reflect these dissociable processes between 
association and source information. 

Interactions Between Reward-/Punishment-Related and 
Memory-Related Regions 

The third main finding of our study was that activation in the 
hippocampus as a memory-related region showed significant 
correlations with that in reward/punishment-related regions 
including the VTA/SN, NA, and insula, and that the hippocam- 
pal activation during the successful encoding of item and 
source memories was also greater in the Reward and Punish- 
ment conditions than in the Control condition. This corre- 
lation pattern was identified in both levels of inter- and 
intraparticipants. However, such correlation patterns were not 
identified in the PHC as another memory-related region, and 
activations in the VTA/SN, NA, and insula were not affected 
by a successful encoding factor. These findings suggest that 
activation in reward/punishment-related regions could modu- 
late source memory-related hippocampal activation, but not 
PHC activation. 

The finding of significant correlations between the hippo- 
campus and reward/punishment-related regions during the 
successful encoding of IWS memories is consistent with pre- 
vious findings, where the hippocampus showed both anatom- 
ical and functional connections with regions including the 
reward circuit (Lisman and Grace 2005; Haber and Knutson 
2010) and insular region (Pribram and Maclean 1953; Rutecki 
et al. 1989). For example, there is functional neuroimaging 
evidence that the enhancing effect of rewards on memory is 
greater in the recollection process than in the familiarity 
process, and this memory enhancement is modulated by inter- 
actions between reward-related regions, including VTA/SN, 
NA, and mOFC, and a recollection-related region including 
the hippocampus (Adcock et al. 2006; Tsukiura and Cabeza 
2008, 2011). Other fMRI studies demonstrated that activations 
in the insula and hippocampus reflected the subsequent suc- 
cessful retrieval of aversive events and faces with bad 
impressions (Rasch et al. 2009; Tsukiura et al. 2012). Given 
that the hippocampus is involved in the processing of associ- 
ations between item and source information, but not in the 
processing of source information itself (Davachi 2006; Diana 
et al. 2007; Eichenbaum et al. 2007; Mitchell and Johnson 
2009), the present patterns of correlation identified in the hip- 
pocampus extend previous findings by showing that the mon- 
etary rewards and/or punishments processed in the reward/ 
punishment-related circuits affected the association processes 
involved in the hippocampus. However, we did not find that 
correlations between reward-/punishment-related and 
memory-related regions were varied by the effects of a 
reward/punishment factor. This negative result may be due to 
lower statistical powers by a limited number of trials or par- 
ticipants. If correlations between reward-/punishment-related 
and memory-related regions are modulated by a factor of 
reward/punishment, the current study could be far stronger in 
association with our behavioral results. Further investigations 
would be required in future. 

However, such correlation patterns were not found 
between the PHC and reward-/punishment-related regions. 
The findings are consistent with functional neuroimaging 
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evidence that smiling facial expressions as a social reward en- 
hanced activation in both the reward-related mOFC and 
memory-related hippocampal and parahippocampal regions, 
whereas the correlation enhancement by social rewards were 
identified only between mOFC and the hippocampus, and not 
between mOFC and PHC (Tsukiura and Cabeza 2008). The 
dissociable pattern of correlations within the hippocampal 
and parahippocampal regions suggests that the effects of 
reward-/punishment-related activations on memory-related 
activations could contribute to activations in the hippo- 
campus, but not to those in the PHC. The association process 
involved in the hippocampus could be modulated by the 
motivation of receiving rewards or avoiding punishments, and 
the processing of contextual information involved in the PHC 
region could be modulated by the association-related hippo- 
campal activity. 

Conclusions 

Using event-related fMRI, we investigated the effect of monet- 
ary reward and punishment on brain activation during the 
successful encoding of IWS memories. Activation in the VTA/ 
SN and NA regions reflected the predictions of both monetary 
rewards and punishments, whereas activation in the insular 
region increased as a function of monetary punishments. 
Activation in the hippocampus and PHC during encoding 
predicted the subsequent retrieval success of item and 
source memories. Finally, correlation coefficients between 
activations in the hippocampus and reward/punishment- 
related regions during the successful encoding of item 
and source memories were significant, but the PHC region 
showed no significant interaction with any reward-/ 
punishment-related regions. Taken together with our behavioral 
results, the enhancing effect of rewards/punishments on rWS 
memories could be modulated by interactions between reward/ 
punishment-related and memory-related hippocampal regions. 
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